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We show that extensive thermostatistics based on Renyi 
entropy and Kolmogorov-Nagumo averages can be expressed 
in terms of Tsallis non-extensive thermostatistics. We use this 
correspondence to generalize thermostatistics to a large class 
of Kolmogorov-Nagumo means and suitably adapted defini- 
tions of entropy. 
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Generalized averages of the form 



= (j> 



k 



Pk4>(xk) 



(i) 



where <f> is an arbitrary continuous and strictly monotonic 
function, were introduced into statistics by Kolmogorov 
[ 1| and Nagumo M, and further generalized by de Finetti 
[|, Jessen [§, Kita gawa H, Aczel || and many oth- 
ers. Their first applications in information theory can be 
found in the seminal papers by Renyi (^,|| who employed 
them to define a one-parameter family of measures of in- 
formation (a-entropies) 

Ia=^ 1 (j2pkM^g b -)) =-^— l0g 6 (5>£). (2) 
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The Kolmogorov-Nagumo (KN) function is here tp a (x) = 
fo(i-a)x^ a cno i ce motivated by a theorem |J stating that 
only afhne or exponential </> satisfy 



(x + C)^ = (x), p + C 
where C is a constant. Random variable 



logfcPfc 



(3) 



(4) 



represents an amount of information received by learn- 
ing that an event of probability pk took place Jio| , pl| ; 
b specifies units of information (6 = 2 corresponds to 
bits; below we use 6 = e which is more common in the 
physics literature), a-entropies were also derived in a 
purely pragmatic manner in |l2| ] as measures of informa- 
tion for concrete information-theoretic problems. 

Renyi's definition becomes more natural if one notices 
that KN-averages are invariant under <f>(x) i— > A<f>(x) + B 
and one replaces tp a by 



e (l~a)x _ ^ 

<t>a{x) = — = ki Q [exp(x)] 
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a 



(5) 



where ln Q (-) is the deformed logarithm [[Uj (hii(-) = 
ln(-)). 

The above (original) derivation of I a clearly shows the 
two elements which led Renyi to the idea of a-entropy: 
(1) one needs a generalized average and (2) the random 
variable one averages is the logarithmic measure of in- 
formation. The latter has a well known heuristic ex- 
planation which goes back to Hartley p3[| : To uniquely 
specify a single element of a set containing N numbers 
one needs log 2 N bits; but, if one splits the set into 
n subsets containing, respectively, N\,..., N n elements 
(Y^i Ni = N) then in order to specify only in which set 
the element of interest is located it is enough to have 
log 2 N — log 2 Ni — log 2 (A r '/ 7Vj) bits of information. The 
latter construction ignores the information encoded in 
correlations between the subsets. For this reason typi- 
cally one needs less information if such correlations are 
present. The idea is used in data-compression algorithms 
and is essential for the argument we will present below. 

Although a-entropies are occasionally used in statis- 
tical physics |H| it seems the same cannot be said of 
KN-averages. Thinking of the original motivation be- 
hind generalized entropies one may wonder whether this 
is not logically inconsistent. Constructing statistical 
physics with a-entropies one should consistently apply 
KN-averaging to all random variables, internal energy 
included. Applying the procedure to thermostatistics 
one may expect to arrive at a one-parameter family of 
equilibrium states which, in the limit a 1, reproduce 
Boltzmann-Gibbs statistics. 

During the past ten years it became quite clear that 
there is a need for some generalization of standard ther- 
mostatistics, as exemplified by the unquestionable suc- 
cess of Tsallis' ^-thermodynamics [0. Systems with 
long-range correlations, memory effects or fractal bound- 
aries are well described by q ^ 1 Tsallis-type equilibria. 
Gradual development of this theory allowed to under- 
stand that there is indeed a link between generalized en- 
tropies and generalized averages. However, the averages 
one uses in Tsallis' statistics are the standard linear ones 
but expressed in terms of the so-called escort probabili- 
ties. So there is no direct link to KN-averages. 

In what follows we present a thermostatistical theory 
based on KN-averages. It deals with the problem of max- 
imizing average information under the constraint that the 
average of some energy function has a given value. As we 
shall see there is a link between such a theory and Tsallis' 
thermostatistics. Actually, many technical developments 
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obtained within the Tsallis scheme have a straightfor- 
ward application in the new framework. An important 
difference with respect to the Tsallis theory is that we 
can obtain both non-extensive and extensive generaliza- 
tions so that one may expect the formalism will have still 
wider scope of applications. 

We begin with the KN-average depending on param- 
eters pk which we shall later identify with escort proba- 
bilities, a-entropy defined with the help of the modified 
KN-function (|) is 

ia = ^ X (X)P*^( J *)) =^a 1 (2P*0«(-Inp*)) (6) 



^(EflfeMVp*))- (7) 
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It is interesting that in the course of calculation of I a the 
expression for the Daroczy-Tsallis entropy [|15|-|l7|] arises 



Sa(p) 



1-a ' 



(8) 



This shows that in the context of KN-means there is an 
intrinsic relation between I a and S a : 



4>a{Ia) = S a . 

Let us note that the formula 

4>a{h) = ln a (l/p fe ) 



(9) 



(10) 



may hold also for other pairs {(j) a , Ik), with (j) a not given 
by (|5|), and be valid even for measures of information 
different from the Hartley-Shannon- Wiener random vari- 
able Ik = — lnpfe. The key assumption of the present 
paper is that the generalized theory is characterized by 
the properties (||) and (|l0|). One can see (10) as a defi- 
nition of Ik in case <p a is given, or as a constraint on <fr a 
if Ik is given. 

The generalized thermodynamics is obtained by max- 
imizing I a under the constraint of fixed internal energy 

(PoH)^ = <i>- x (j^nMPoEkj) =PoU (11) 
k 

where /3q is a constant needed to make the averaged en- 
ergy dimcnsionless. Equivalently, the problem may be 
reformulated as maximizing (|^) under the constraint 



(12) 



This problem is of the type originally considered by 
Tsallis |l(|. However, since then the formalism of non- 
extensive thermostatistics has evolved. In particular, one 
has learned Jl8| that the optimization problem should be 
reparamctrized using the so called escort probabilities. 
The reason why one should do so is the following. The 
standard thermodynamical relation for temperature T is 



1 
T 



dS_ 

dU 



(13) 



with S and U, respectively, entropy and energy calcu- 
lated using the equilibrium averages. In generalized ther- 
mostatistics this definition of temperature is not neces- 

H that @ 



sarily correct. Recently has been shown 
is valid if the entropy is additive and must be modified in 
all other cases. The reparametrization of non-extensive 
thermostatistics, by introduction of escort probabilities, 
is such that energy U becomes generically an increas- 
ing function of some (unphysical) temperature T* (see 
e.g. Prop. 3.5 of ^4|), which is then related to physical 
temperature T. 

The reparametrization is done by means of q 1/q 
duality p@. Let 



Pk 



Pk 



EkPk 

Then one has clearly also the inverse relation 



Pk 



Pi 



Efcpfe 



(14) 



(15) 



with q — l/a. The above optimization problem is now 
equivalent to maximizing S q (p) under the constraint 



Efc_P|^i/gCgogfc) 



<h/q(PoU) 



(16) 



This is so because S q (p) is maximal if and only if Si/ q (p) 
is maximal (see JT^] ) . The latter optimization problem is 
of the type studied in the new style non-extensive ther- 
mostatistics jf8|. 

We are now ready to solve the optimization problem. 
The free energy F is defined by 



EkPl 



Minima of (3qF, if they exist 
tributions of the form fp~8(l 



(3 T*S q (p) (17) 
7|, are realized for dis- 
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Pk 



if Kg 



(18) 



[l + axfcP/t?-!) 
or 

p k - [1 - axk] 1 ^ 1 ^ if < q < 1 (19) 

Here Xk — 4>i/ q (0oEk) and [x\+ equals x if x is positive, 
zero otherwise. Expression (Q), with 1/(^ — 1) replaced 
by 1 + k, is called the kappa-distribution or generalized 
Lorentzian distribution pEfl . There are several reasons 
why this distribution is of interest. In the first place, the 
Gibbs distribution, which determines the equilibrium av- 
erage in the standard setting of thermodynamics |26|] , is 
obtained in the limit k —* +oo, or q — > 1. The kappa- 
distribution is frequently used. For example in plasma 
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physics it is used to describe an excess of highly energetic 
particles Typical for distribution (|ig| ) is that the 

probabilities pk are identically zero whenever aEk > 1. 
This cut-off for high values of E k is of interest in many 
areas of physics. In astrophysics it has been used |2(3] to 
describe stellar systems with finite average mass. A sta- 
tistical description of an electron captured in a Coulomb 
potential requires the cut-off to mask scattering states 
[^2|,^9|. In standard statistical mechanics the treatment 
of vanishing probabilities requires infinite energies which 
lead to ambiguities. These can be avoided if distributions 
of the type ( |l9| ) are used. 

The formulas that follow are based on results already 
found in literature at many places, e.g. in 24 1. 

Assume first that a = l/q, < a < 1. Then the 
equilibrium average is the KN-average with pk given by 



1 



1 



Pk 



Zi [1 + axk] 1 ^ 1 -^ ' 



Z\ is given by 



[l + axk] 1 '^-**)' 



(20) 



(21) 



and Xk = (fraiftoEk). The unknown parameter a has to 
be fixed in such a way that ( ft2] ) holds. This condition 
can be written as 



a \Zi 



with Zq given by 



i 



[1 + ax k ] a /( 1 - a ) 



(22) 



(23) 



The entropy I a follows from (]|) with (pp|). One obtains 

(24) 



4>M = ^-(^-i 

1 — a \ Zr 



Temperature T* is given by (cf. Eq. (14) in gj ) 

1 aa Z\ 

f3 T* ~ 1-a z^ +a)/a ' 

Now assume a > 1. Then the formulas become 
Pk = -^-[i - ax k \+ y 



with Z\ given by 



Zi = }}1 - ax k ] 



l/(a-l) 



The expressions for energy and entropy are 



a \ Zi 



(25) 



(26) 



(27) 



(28) 



and 



with 



a — 1 \ Zf 



Zq = 2J[1 - ax k ] 



a/{a-l) 
+ 



Temperature T* is given by 
1 aa 



1 7 (l+«)/c 



(29) 



(30) 



(31) 



Let us finally return to the specific case of Renyi's en- 
tropy, i.e. Ik and (f> a given, respectively, by (f|) and (||). 
This choice is particularly interesting since only then the 
following three conditions are satisfied 

(PoH + PoE)^ = WoH}^ + f3 E (32) 
{PoHa+b}^ = (PoHaU* + (PoHb)^ (33) 
I a {A + B)=I a {A)+I a {B) (34) 

where A and B are two uncorrelated noninteracting sys- 
tems. Condition (|3^) when combined with the explicit 
form of equilibrium state means that equilibrium does 
not depend on the origin of the energy scale. The remain- 
ing two conditions imply that we have a one-parameter 
family of extensive generalizations of the Boltzmann- 
Gibbs statistics, the latter being recovered in the limit 
a — > 1. For a = q^ 1 ^ 1 we obtain the well known 
Tsallis-type kappa-distributions but with energies (3Ek 
replaced by 4> a ([3 E k ). 

In general, the equilibrium probabilities are not of the 
product form (there is one exception — see below). The 
product form is of course also absent in the standard 
formalism when there are correlations between subsys- 
tems. Nevertheless, if the correlations are not too strong, 
then the system in equilibrium is still extensive. This is 
expressed by stating that the so-called thermodynamic 
limit exists. We expect that also in the present formal- 
ism the thermodynamic limit exists, but this point has 
still to be studied. 

Consider now the case < a < 1 and a — 1 — a. This 
is a remarkable case because the equilibrium distribution 
(pp|) becomes exponential. Indeed, one verifies that 



1 

Pk = -z-e 



-PoE k 



with Z"i 



(35) 



Internal energy equals 



InZi. (36) 



This means that for each system there exists a particular 
temperature where the equilibrium state is factorizable. 
Let us summarize the results. 
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The formalism of thermostatistics based on KN- 
averages simultaneously generalizes Boltzmann-Gibbs 
and Tsallis theories. As opposed to the Tsallis case, 
which is always nonextensive, the KN-approach allows 
for a family of extensive generalizations. On the other 
hand, the family of extensive theories leads to equilibrium 
states which share many properties with Tsallis 5 ^ 1 dis- 
tributions. Tsallis formalism enters the KN-formulation 
also via the relation between I a and S a . What is surpris- 
ing is that one should not simply identify a with q. The 
correct relation a = 1/q is suggested by the fact that the 
probabilities pk are interpreted as escort probabilities. In 
the present paper the function <j) a is kept constant while 
the probabilities pt are varied. It could be interesting to 
consider also the case where <j) a is varied as well. 

Of particular interest is the choice <p a (x) = ln Q (exp a;) 
since then the average information coincides with Renyi's 
entropy. As proved by Renyi, his entropy, together with 
that of Shannon JhJ, are the only additive entropies. As 
shown in [ p8|]2S| ] additivity of entropy is a requirement 
for physical temperature T to be defined by the usual 
thermodynamic relation (|l^) . The formalism generalizes 
to other non-exponential choices of <fi provided the infor- 
mation measure is adapted in such a way that (^) and 
@ still hold. In this more general context entropy is no 
longer additive and the definition of physical tempera- 
ture T by means of ( |l3| ) becomes problematic. A correct 
definition could be derived along the lines of or [^9) . 
This problem requires further study. 

In a natural way Tsallis' entropy appears as a tool 
for calculating equilibrium averages. This offers the op- 
portunity to reuse the knowledge from Tsallis-like ther- 
mostatistics. A tempting question is whether in each of 
the many applications of Tsallis' thermostatistics one can 
find a natural KN-average which maps the problem into 
the present formalism. 

In an extended version of this Letter we shall discuss 
explicit examples. Here we only mention that prelimi- 
nary results for a two-level system give satisfactory re- 
sults. In particular, we checked that the a — > 1 limit 
of equilibrium distributions reproduces Boltzmann-Gibbs 
results, and that the relation between T and T* was 
found as in |p8| . Of course, more complicated examples 
should be studied. Examples like the one-dimensional 
Ising model could clarify the issue of the thermodynamic 
limit. 

For the sake of completeness let us mention that 
Renyi's entropy has been studied already (23) in relation 
with the escort probabilities (14). One of the conclusions 
of that paper is that they obtain the same results as 
in Tsallis' thermostatistics, which is not a surprise since 
Renyi's entropy and Tsallis' entropy are monotonic func- 
tions of each other. There is nor further relation with the 
present work. 

One of the authors (MC) wishes to thank the NATO 
for a research fellowship enabling his stay at the Univer- 
siteit Antwerpen. 
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